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ABSTRACT 

VActive  sonar  systems  furnish  the  operator  large  quan- 
tities of  data  to  examine  for  possible  targets.  In  order  to 
detect  small  target  returns,  the  display  thresholds  must  be  set 
such  that  clutter  is  significant.  On  a PPI  display  this  clutter 
makes  it  difficult  to  visually  integrate  successive  pings. 

This  report  shows  a technique  utilizing  a digital  com- 
puter to  examine  the  data  out  of  a sonar  system,  reduce  its 
volume,  perform  ping-to-ping  integration,  make  simple  decisions, 
and  generate  useful  displays.  The  process  takes  advantage  of  a 
statistical  decision  procedure  called  sequential  hypothesis 
testing. 


Specifically,  the  technique  is  not  dependent  on  a 
particular  sonar  system;  it  is  well  founded  mathematically,  and 
sufficiently  simple  to  make  real  time  implementation  possible 
on  a modest  state-of-the-art  computer. 


There  is  no  fundamental  limit  on  the  number  of  echo 
cycles  to  be  considered  for  ping-to-ping  integration,  in  the 
decision  process.  v 


i 


s 


y 


6SOO  THAI'OR  IANI 


AUSTIN.  TFXAS  7 8/.>J 


TABLE  OF  CONTENTS 

Section 

ABSTRACT 

LIST  OF  ILLUSTRATIONS 

1 . INTRODUCTION 

] . 1 HIGHLIGHTS 

1.2  PROBLEM 

1.3  TECHNIQUE  FOR  A SOLUTION 

1.4  PARAMETERS 

1 . 5 SUMMARY 

2.  THE  LIKELIHOOD  RATIO  AND  ITS  USEFULNESS  IN 
STATISTICAL  DECISION  THEORY 

2.1  HYPOTHESIS  TESTING 

2.2  MULTIPLE  OBSERVATIONS 

2.3  SEQUENTIAL  TESTING 

2.4  TRACKING 


3.  COMPUTER  PROCESS  DESCRIPTION 

3.1  INTRODUCTION 

3.2  PRELIMINARY  DATA  REDUCTION 

3.3  NEW/STATUS  LINKAGE 

3.3.1  Status  File 

3.3.2  Linkage  Process 

3.4  SECONDARY  DATA  REDUCTION 

3.5  STATUS  DATA  REDUCTION 

3.6  REDUNDANCY  REMOVAL 

3.7  OUTPUT  DISPLAY 

3.8  SUMMARY 

4.  IMPLEMENTATION  OF  A SIMPLIFIED  PROBLEM 

4.1  PROBLEM  DESCRIPTION 

4.2  OUTPUT  DISP1AY 

4.3  EXAMPLES 


T , 


Page 

1 

iv 

1 

1 

1 

2 
2 
3 

5 

5 

7 

8 
9 

11 

11 

11 

13 

13 

13 

14 

15 

15 

16 
16 

17 

17 

17 

18 


ii 


APPENDIX 

A SEQUENTIAL  TESTING  OF  HYPOTHESES  A-l 

A, l Structure  of  Sequential  Test  A-l 

A. 2 Termination  of  the  Test  A-l 

A. 3 Thresholds  A-3 

A. 4 Rules  for  Sequential  Test  A-5 

B DERIVATION  OF  A LOG  LIKELIHOOD  RATIO  B- 1 


Mi 


Figure 

1 

2 

3 


5 

6 


6500  TRACOR  LANE.  AUSTIN.  TEXAS  78721 

LIST  OF  ILLUSTRATIONS 

Typical  Probability  Density  Function  and 
Likelihood  Ratio 

General  Organization  of  Logic  and  Data  Flow 

Three  Simulated  Target  Tracks.  Display 
Threshold  On  Log  Likelihood  Ratio  is  2.94 

Three  Simulated  Target  Tracks.  Display 
Threshold  On  Log  Likelihood  Ratio  is  9.15 

Sea  Test  Data.  Assumed  Output  S/N=13.7  dB 
Sea  Test  Data.  Assumed  Output  S/N=17  dB 


page 

6 

12 

20 

21 

22-24 

25-27 


iv 


6500  T HACOH  LANf  AUSTIN.  TEXAS  78721 


1.  INTRODUCTION 


HIGHLIGHTS 


A technique  for  accomplishing  computer-aided  detection 
and  classification  has  been  developed.  Highlights  of  the  tech- 
nique are: 

1.  The  basic  detection  algorithm  is  not  dependent 
upon  a particular  sonar  system;  rather,  it  is  applicable  to  any 
one  of  a quite  large  class  of  active  sonar  systems. 

2.  The  procedures  used  are  well-founded  mathematically, 
rather  than  being  empirical,  and  can  be  shown  to  be  optimal  from 
the  standpoint  of  statistical  decision  theory. 

3.  The  necessary  logical  and  arithmetic  calculations 
are  simple.  This  should  allow  real  time  implementation  on  a 
reasonably  modest  state-of-the-art  digital  computer. 

4.  In  the  basic  decision  process  there  is  no  funda- 
mental limit  on  the  number  of  echo  cycles  to  be  considered  for 
ping-to-ping  integration;  as  much  of  the  available  data  is  used 
as  is  necessary. 

The  remainder  of  the  introduction  gives  a brief,  general 
discussion  of  the  technique  and  the  parameters  involved.  A more 
complete  discussion  of  the  theory  and  information  flow  is  given 
in  Sections  2 and  3.  Section  4 discusses  how  the  technique  was 
implemented  for  a particular  problem  and  gives  results  for  dif- 
ferent situations. 

1.2  PROBLEM 

Active  sonar  systems  furnish  the  operator  large  quanti- 
ties of  data  to  examine  for  possible  targets.  In  order  to  detect 
small  target  returns,  the  display  thresholds  must  be  set  such 
that  clutter  is  significant.  On  a PPI  display  this  clutter  makes 
it  difficult  to  visually  integrate  successive  pings.  By  display- 
ing several  successive  A-type  scans,  ping-to-ping  integration  may 


« 
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be  accomplished  and,  consequently,  the  probability  of  detection 
is  increased.  However,  the  best  results  are  obtained  only  when 
an  alerted  operator  is  handling  this  mass  of  data.  On  long 
searches  with  few  targets,  this  alerted  condition  would  be  diffi- 
cult to  maintain,  and  a computer  detection  and  classification 
system  may  be  more  responsive  to  low  signal-to-noise  ratio  targets. 

1.3  TECHNIQUE  FOR  A SOLUTION 

This  report  shows  a technique  utilizing  a digital  computer 
to  examine  the  data  out  of  a sonar  system,  reduce  its  volume,  per- 
form ping-to-ping  integration,  make  simple  decisions,  and  generate 
useful  displays.  The  process  takes  advantage  of  a statistical 
decision  procedure  called  sequential  hypothesis  testing.  In  this 
procedure,  the  amplitude  of  a promising  return  peak  is  transformed 
bv  a function  dependent  on  the  output  statistics  of  the  sonar  proc- 
essor. If  the  resulting  value  is  greater  than  a certain  threshold 
value,  the  peak  is  accepted  as  a possible  target  and  displayed.  If 
it  is  below  a lower  threshold  value,  the  peak  is  rejected  as  a non- 
target. If  it  is  between  the  two  thresholds,  it  is  retained  in 
the  computer,  along  with  other  information  about  the  peak,  to  form 
a track.  On  the  next  ping,  the  volume  to  which  a target  might  move 
is  searched  for  possible  target  peaks.  Linkages  are  made  with  the 
new  peaks,  and  a statistic  based  on  both  peaks  is  calculated.  The 
decision  process  to  test  whether  the  track  is  target,  non-target, 
or  undetermined  is  repeated  using  the  same  thresholds.  A track 
may  be  undetermined  for  as  many  pings  as  are  necessary  to  make  the 
appropriate  final  decision. 

1.4  PARAMETERS 

By  choosing  a display  threshold  for  the  track  statistic 
that  corresponds  to  the  statistic  obtained  by  a single  peak  return 
with  an  amplitude  of  4 to  5 noise  standard  deviations  above  the 
noise  mean,  a significant  reduction  in  clutter  rate  is  achieved. 
Ping-to-ping  integration  of  weak  target  tracks  with  individual 
peaks  less  than  that  value  is  left  to  the  computer  until  a decision 
is  reached. 
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Besides  the  display  threshold  there  are  other  parameters 
involved  in  the  procedure;  however,  these  would  be  changed  only 
occasionally.  The  lower  rejection  threshold  should  be  set  so  that 
the  probability  of  a true  target  track  being  rejected  is  small. 

The  transformation  of  peak  amplitude  to  the  testing  statistic 
requires  an  assumed  target  s ignal- to-noise  ratio;  the  testing 
procedure  is  optimal  for  tracks  of  this  s ignal-to-noise  ratio, 
with  only  slight  degradation  for  target  tracks  at  higher  signal- 
to-noise  ratios. 

For  tracks  below  the  assumed  s ignal-to-noise  ratio, 
degradation  for  the  testing  procedure  increases  slowly,  at  first, 
with  decreasing  track  signal-to-noise,  then  rapidly  until  a sharp 
cutoff  is  reached  about  6-8  dB  below  the  assumed  signal-to-noise 
ratio.  Tracks  with  average  signal-to-noise  ratios  below  this 
cutoff  value  will  not  integrate  up  to  the  display  threshold.  It 
is  desirable  to  have  the  assumed  signal-to-noise  ratio  low,  but 
if  it  is  too  low,  the  probability  that  a noise  track  or  peak  will 
be  treated  as  a target  track  increases,  and  consequently  the  clutter 
rate  increases. 

Since  a target  only  can  move  a certain  distance  each  ping 
cycle,  it  is  possible  to  limit  the  number  of  peaks  in  each  cycle 
that  can  be  linked  with  an  established  track.  In  general,  the 
more  stringent  the  limits,  the  faster  the  decision,  target  or 
non-target,  will  be  made.  On  the  other  hand,  too  severe  limits 
would  not  allow  linkages  on  a track  of  a maneuvering  target.  Hence, 
these  limits  should  be  dependent  on  the  characteristics  of  possible 
targets  in  a particular  area. 

1.5  SUMMARY 

With  the  technique  described  above,  a computer  can  be 
used  not  only  to  reduce  the  output  rate  of  the  sonar  system  to  an 
acceptable  level,  but  also  to  enhance  the  probability  of  detection 
of  target  tracks  by  ping-to-ping  integration. 
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The  selectivity  of  the  process  can  be  used  to  limit  the 
number  of  possible  targets  to  be  subjected  to  further  classifica- 
tion procedures,  which  take  computer  time  and  core  memory  to 
accomplish.  The  exact  classification  procedures  to  be  implemented 
would  depend  on  the  sonar  system  and  the  pulse  form  cransmitted. 

In  addition  to  the  two  classification  clues,  target  strength  and 
track  consistency,  used  in  the  process,  some  of  the  items  that 
could  be  checked  are  Doppler  consistency  of  echo,  echo  length, 
wake,  highlights,  and  aspect.  Further  study  is  needed  to  apply 
these  descriptors  to  the  detection  and  classification  process. 

The  computer  can  perform  other  functions  such  as  range  prediction, 
mode  selection,  attack  problems,  and  training,  but  these  are  out- 
side the  scope  of  the  present  report. 
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2.  THE  LIKELIHOOD  RATIO  AND  ITS  USEFULNESS 
IN  STATISTICAL  DECISION  THEORY 

2.1  HYPOTHESIS  TESTING 


The  fundamental  problem  of  statistical  decision  theory 
is  that  of  choosing  one  of  several  hypotheses  by  making  observations 
of  some  quantity.  A great  deal  of  generality  can  be  included 
in  defining  the  algorithm  to  optimally  carry  out  this  procedure. 

A simplified  approach  will  be  taken  here.  Assume  that  the  number 
of  hypotheses  available  is  two,  and  refer  to  these  hypotheses  as 
Hq  and  Hj.  In  the  problem  under  consideration  Hq  is  the  hypothesis 
"the  track  is  non-target  or  noise  to  be  rejected"  and  H^  is 
"the  track  is  a target  to  be  displayed".  It  is  also  assumed 
that  the  quantity  to  be  observed  is  a single  numerical  value. 

1!  the  hypothesis  Hq  is  true,  then  observed  values  of  the 
quantity  x will  be  described  by  a known  probability  density 
function,  P(^x)»  such  as  the  one  shown  in  Fig.  1.  In  a similar 
wav,  if  H^  is  true,  then  there  will  be  a different  probability 
density  function,  Pi(x)>  f°r  the  observed  values  of  x.  For  the 
examples  shown  in  Fig.  1,  x might  be  thought  of  as  the 
amplitude  of  a peak;  Pq  as  the  distribution  under  the  conditions 
of  noise  alone;  and  p^  as  the  distribution  when  signal  plus  noise 
is  present.  The  likelihood  ratio,  L(x) , is  defined  as 


L(x) 


Px(x) 
P^Tx)  ’ 


Tn  many  cases  the  likelihood  ratio  is  a monoton ical lv  increasing 
function  of  the  observation  quantity  x.  In  this  example,  large 
values  of  the  likelihood  ratio  tend  to  imply  a choice  of  Hj * 
while  small  values  of  the  likelihood  ratio  tend  to  imply  a choice 
of  Hq.  Thresholds  need  to  be  established  on  L(x)  for  our  decision 
process.  There  are  several  techniques  for  picking  an  optimal 
threshold  which  differ  primarily  in  the  amount  of  a priori 
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information  that  is  known  about  the  problem.  For  sonar  applications 
most  of  the  assumed  quantities  in  the  highly  optimal  techniques 
are  simply  not  known.  The  threshold,  in  this  case,  will  likely 
be  based  upon  what  false  alarm  rate  or  clutter  rate  can  be  tolerated 
rather  than  upon  the  classical  approach  from  a standpoint  of 
decision  theory. 


2.2  MULTIPLE  OBSERVATIONS 

If  several  observations  of  the  quantity  (x^ ,x3 ,x3 ,etc . , ) 
are  to  be  made,  then  a joint  likelihood  ratio  for  the  set  of 
observations  would  be  defined  as  the  ratio  of  the  appropriate 
multi-dimensional  probability  density  functions, 


L(x^ ,X2 ,x3  , • ■ * ) 


4 


P1(x1,x2,x3,  . . .) 

p^Tx^TxJ^TTTT) 


If  the  observations  made  are  all  statistically  independent,  then 
the  appropriate  multi-dimensional  probability  density  function 
is  simply  the  product  of  the  individual  one -dimensional  probability 
density  functions  : 

Px (>c1)  •P1(x2)  ’P1(x3)  • • • 

L(x1,x2,x3,...)  = p0(x1).p0Cx2).p0Cx3)'.7.  • 


This  yields  a significant  simplification  and  also  introduces 
the  logarithm  of  the  likelihood  ratio  as  a very  useful  quantity. 
The  multiplication  of  individual  observation  likelihood  ratios 
to  obtain  a joint  likelihood  ratio  can  be  avoided  by  using  the 
logarithm  of  the  likelihood  ratio  as  the  fundamental  quantity. 
The  logarithm  of  the  joint  likelihood  ratio  can  be  obtained 
as  the  sum  of  the  logarithms  of  individual  ratios: 

Pi  (xi) 

f (Xi)  £ Log(L(xi))  = L°g(pQ^~))  » 

and 

t(x1,x2,x3,...)  = Mx-l)  + '(x2)  + + 
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2.3  SEQUENTIAL  TESTING 

It  is  of  interest  to  consider  a system  in  which  the 
number  of  observations  to  be  taken  is  not  a fixed  quantity  but, 
instead,  a decision  is  to  be  made  when  specified  confidence 
levels  are  reached.  This  technique  of  observation  is  known  as 
sequential  testing.  In  this  approach,  two  thresholds  are  estab- 
lished. The  first  threshold  t^  is  a threshold  such  that  if  the 
joint  log  of  likelihood  ratio  falls  below  this  level,  Hypothesis 
0,  no  signal  is  present,  is  chosen  and  the  testing  chain  stops. 

On  the  other  hand,  if  the  joint  log  of  likelihood  ratio  exceeds 
a second  threshold  t2 , then  Hypothesis  1,  signal  is  present,  is 
chosen.  The  detection  process  is  complete,  though  the  testing 
does  not  stop  but  continues  into  an  automatic  track.  If  the 
joint  log  of  likelihood  ratio  lies  between  the  bounds  of  t^  and 
t2»  no  decision  is  made;  another  sample  is  taken  and  the  decision 
process  is  repeated.  The  situation  is  very  similar  to  that  of 
the  random  walk  problem,  and  it  can  be  shown  that  eventually  one 
of  the  two  boundaries  will  be  crossed  and  a decision  will  be 
reached . 

The  average  number  of  samples  needed  to  reach  a de- 
cision for  given  probabilities  of  wrong  decisions  is  less  than 
the  required  number  for  a fixed  sample  size  test  with  the  same 
given  probabilities.  If  the  track  is  noise,  the  decision  is 
reached  relatively  promptly,  but,  if  the  track  is  a target,  a 
significantly  greater  number  of  samples  may  be  needed  for  a 
decision^. 


T 

Skolnik,  M.  I..  "Introduction  to  Radar  Systems",  McGraw-Hill, 
New  York  (1962). 
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2.4  TRACKING 

In  sonar  applications  one  difficulty  arises  which  does 
not  often  occur  in  other  statistical  decision  theory  applications. 
The  problem  is  that  one  does  not  really  know  uniquely  how  to  take 
a single  "next"  observation.  For  example,  receipt  of  a modestly 
high  peak  on  one  beam,  at  a given  range,  and  perhaps  with  some 
Doppler,  gives  an  indication  of  where  to  look  in  the  next  echo 
cycle,  in  terms  of  beam,  range,  and  Doppler.  This  information, 
however,  cannot  give  a precise  specification  of  the  location  of 
the  linking  data  in  the  next  echo  cycle.  Rather,  it  shows  a 
volume  in  the  next  echo  cycle  which  must  be  scanned,  the  volume 
being  defined  by  a range  interval,  a beam  interval,  and  a Doppler 
interval.  This  volume  must  be  searched  to  determine  whether  any 
linkages  exist  with  the  previous  data. 

Since  multiple  linkages  are  allowed  in  this  process,  the 
probability  of  having  chosen  the  correct  linkage  must  be  used  in 
calculating  the  likelihood  ratio.  Under  the  Hypothesis  Hq,  that 
the  linkage  is  noise,  the  probability  is  1.0  that  a noise  peak  is 
chosen. 

The  probability  of  a correct  linkage  under  the  Hypothesis 
H^  is  the  number  of  true  target  tracks  divided  by  the  number  of 
possible  linkages.  It  is  unlikely  that  there  will  be  more  than 
one  true  target  track  in  any  given  volume,  and  it  will  be  assumed 
that  the  number  of  true  targets  is  1.0.  Since  it  would  be  diffi- 
cult to  count  the  number  of  possible  linkages  each  time,  the 
average  number  of  possible  linkages  will  be  used.  Hence,  the 
likelihood  ratios  must  be  multiplied  by  the  reciprocal  of  the 
average  number  of  possible  linkages,  or,  equivalently,  the  log- 
arithm of  that  number  must  be  subtracted  from  the  log  likelihood 
ratio.  This  points  up  the  advantages  of  having  a highly  localized 
target  track.  If  it  is  possible  by  some  means  to  confine  the 
volume  of  legitimate  linkages  to  a relatively  modest  volume,  then 
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the  amount  that  must  be  subtracted  from  the  log  likelihood 
integration  is  decreased.  On  the  other  hand,  if  the  volume  of 
legitimate  linkages  can  only  be  defined  in  a gross  sense,  then 
from  each  linkage  that  is  established  the  logarithm  of  the  number 
of  independent  samples  in  this  total  volume  must  be  subtracted. 


10 


3.  COMPUTER  PROCESS  DESCRIPTION 
3.1  INTRODUCTION 

The  overall  purpose  of  the  system  is  to  produce  a 
display  on  which  the  returns  most  likely  to  have  resulted  from 
targets  stand-out,  and  on  which  the  tracks  of  these  returns  over 
a number  of  pings  can  readily  be  seen. 

j 

To  accomplish  this  function,  the  system  combines  data 
derived  from  each  ping,  upon  its  return,  with  data  in  the  status 
file,  derived  from  previous  pings.  The  information  flow  is 
summarized  in  Fig.  2. 

\ 3.2  PRELIMINARY  DATA  REDUCTION 

■■  ■ i — ■■  i - — — i ■ 

The  normalized  output  of  the  sonar  signal  processor 
from  the  current  ping  cycle  is  processed  by  the  box  labeled 
"Preliminary  Data  Reduction."  This  processor  has  three  purposes. 
First,  the  data  received  is  grouped  into  single  ping  event 
packages  and  converted  from  analog  to  digital  format,  if  necessary. 
The  event  packages  created  contain  information  such  as  the  time, 
amplitude,  and  Doppler  of  the  event.  Second,  the  box  performs 
a thresholding  function.  The  threshold  can  be  set  sufficiently 
low  that  any  information  of  interest  will  pass,  and  still  be 
sufficiently  high  to  allow  reduction  of  the  volume  passed  by 
90  to  997,.  Third,  the  event  amplitude  is  mapped  to  logarithm  of 
the  likelihood  ratio.  The  specific  transformation  is  dependent 
upon  the  particular  sonar  signal  processing  system  being  used, 

The  techniques  for  the  determination  of  mapping  are  discussed 
in  Appendix  B.  Though  the  exact  transformation  equations  are 
often  complex,  in  every  example  considered  to  the  transformation 
can  be  accurately  approximated  by  a linear  transformation 
equation  of  the  form 

1^  = A + B • . 
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FIG.  2 - GENERAL  ORGANIZATION  OF  LOGIC  AND  DATA  FLOW 
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The  output  of  the  "Preliminary  Data  Reduction"  box  goes 
to  two  places,  New/Status  Linkage,  and  Secondary  Data  Reduction. 

3.3  NEW/STATUS  LINKAGE 

The  "New/Status  Linkage"  box  receives  two  inputs;  one  is 
the  reduced  sonar  output  from  Preliminary  Data  Reduction,  and  the 
other  is  the  status  file  input.  Where  the  reduced  sonar  output 
contains  single  ping  event  packages,  the  status  file  contains 
multi-ping  event  packages. 

3.3.1  Status  File 

For  each  event  logged  in  the  status  file,  four  functional 
quantities  are  maintained: 

1.  The  position  vector  from  the  preceding  echo  cycle. 

2.  The  expected  position  vector  for  the  next  echo  cycle. 

3.  The  variance  vector  for  the  next  echo  cycle. 

4.  The  joint  log  likelihood  ratio  for  the  event. 

For  the  three  vectors,  the  number  of  dimensions  required  depends 
on  the  sonar  system.  For  example,  an  omni-directional  sonar  system 
with  no  Doppler  measuring  capability  would  require  only  a one- 
dimensional vector  indicating  range.  A more  sophisticated  sonar, 
capable  of  measuring  range,  bearing,  and  Doppler,  however,  would 
require  a three-dimensional  vector.  The  variance  vector  defines 
the  volume,  centered  on  the  expected  position  vector,  within 
which  legitimate  linkages  can  occur  for  the  next  echo  cycle. 

In  the  one -dimensional  situation,  for  example,  the  variance  vector 
would  define  an  interval  of  interest  along  the  range  scale. 

3.3.2  Linkage  Process 

The  "New/Status  Linkage"  process  compares  each  status 
file  entry  with  the  single-ping  event  packages  frcm  the  reduced 
sonar  output.  If  the  single  ping  event  position  vector  lies 
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within  the  volume  of  suspicion  of  a status  file  entry,  the  single- 
ping event  is  said  to  be  linked  with  the  status  file  entry.  For 
linked  events,  information  from  the  status  file  entry  can  be 
processed  in  conjunction  with  the  single-ping  event  position  vector 
to  generate  a new  estimated  position.  This  information  can  also 
be  processed  to  obtain  a new  variance  vector. 

The  joint  log  likelihood  ratio  of  the  new  multi-ping  event 
can  be  evaluated  by  adding  the  log  likelihood  ratios  of  the  multi- 
ping event  in  the  status  file  and  the  single-ping  event  and  sub- 
tracting the  logarithm  of  the  number  of  independent  samples  in  the 
volume  of  suspicion  of  the  status  file  entry.  If  this  new  joint 
log  likelihood  ratio  is  less  than  the  lower  decision  threshold, 
the  Hypothesis  Hq  "The  track  is  noise"  is  accepted  and  the  track 
is  discarded.  Otherwise,  the  multi-ping  event  is  entered  in  the 
new  status  file. 

A status  file  entry  is  allowed  to  link  with  all  events 
which  fall  within  its  volume  of  suspicion.  Similarly,  a single- 
ping event  can  fall  in  the  volumes  of  suspicion  of  several  status 
file  entries  and  hence  be  linked  in  several  ways.  The  procedure 
allows  many  incorrect  linkages,  but,  since  all  incorrect  linkages 
will  yield  a track  which  will  be  integrating  noise,  the  log  likeli- 
hood ratio  will  tend  to  decrease,  and  the  track  will  eventually  be 
dropped. 

3.4  SECONDARY  DATA  REDUCTION 


The  reduced  sonar  output  is  also  processed  by  the  "Secondary 
Data  Reduction"  box,  which  may  make  entries  into  the  status  file 
based  upon  amplitude  of  single-ping  events.  The  criterion  for 
making  an  entry  in  the  status  file  is  that  the  log  likelihood 
ratio  for  the  single  event  be  greater  than  the  lower  decision 
threshold  corresponding  to  Hypothesis  Hq  "The  track  is  noise". 
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The  log  likelihood  ratio  and  present  position  vector  are 
entered  in  the  appropriate  positions  of  the  status  file  entry. 

The  estimated  position  vector  and  a rather  gross  variance 
factor  are  determined  and  entered  in  the  status  unit.  These  factors 
depend  upon  whether  Doppler  information  is  available. 

During  the  first  echo  cycle,  when  there  are  no  previously 
acquired  status  units,  the  "Secondary  Data  Reduction"  box  is  the 
only  one  in  operation.  In  each  echo  cycle  it  is  here  that  new 
tracks  are  started.  The  entire  process  does  not  preclude  a single 
large  echo  return  being  entered  in  the  status  file  and,  indeed, 
being  placed  on  the  output  display  immediately. 

3.5  STATUS  DATA  REDUCTION 

In  addition  to  furnishing  information  to  the  "New/Status 
Linkage"  box,  the  Status  File  is  processed  by  the  "Status  Data 
Reduction"  box.  This  procedure  propagates  a status  file  entry 
associated  with  a strong  track  even  though  the  echo  for  the  track 
may  not  occur  during  a particular  echo  cycle.  This  avoids  losing 
a well-established  track  because  of  a single  miss.  The  status 
data  reduction  procedure  degrades  the  joint  log  likelihood  ratio 
of  each  status  file  entry.  If  the  degraded  log  likelihood  ratio 
still  exceeds  the  required  lower  threshold,  then  an  entry  is  made 
propagating  the  track  entry.  The  variance  vector  is  also  adjusted 
to  accommodate  the  increased  uncertainty  of  the  target  position. 

3.6  REDUNDANCY  REMOVAL 

Because  of  the  independent  operation  of  the  three  status 
file  entry-generating  procedures,  it  is  possible  to  develop 
several  status  file  entries  with  the  same  predicted  and  present 
locations.  These  entries  are  redundant  since  they  really  des- 
cribe different  tracks  that  have  merged  into  identical  tracks. 

The  redundancy  removal  procedure  scans  the  entries  to  detect 
these  redundancies  and  removes  all  except  the  single  entry  with 
the  largest  track  log  likelihood  ratio. 
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OUTPUT  DISPLAY 


The  updated  Status  File  furnishes  information  for  the 
output  display  section.  The  operator  should  have  control  over 
the  display  threshold  on  the  log  likelihood  ratios  stored  in  the 
status  unit.  If  a log  likelihood  ratio  exceeds  this  threshold, 
the  Hypothesis  "The  track  is  a target"  is  accepted  and  the 
status  unit  is  displayed.  By  varying  this  threshold  an  operator  can 
look  at  the  status  file  in  more  detail  if  something  of  interest 
turns  up.  A change  in  the  output  display  threshold  immediately 
changes  what  is  on  the  display.  There  is  no  need  to  wait  for 
events  to  start  accumulating  on  the  display,  since  the  accumula- 
tion has  already  occurred,  and  the  data  are  in  storage. 

3.8  SUMMARY 

The  output  from  the  sonar  processor  for  the  most  recent 
echo  cycle  is  combined  with  information  from  previous  echo  cycles 
to  form  an  updated  status  file  that  contains  information  for  dis- 
play and  for  the  next  echo  cycle.  The  process  does  not  include 
a fundamental  specification  of  the  number  of  pings  over  which  ping 
integration  will  be  carried.  Indeed,  a single  status  file  entry 
could  represent  a track  which  has  been  propagated  for  an  indefinite 
number  of  pings.  A change  in  the  lower  decision  threshold  for 
rejecting  status  file  entries  affects  only  the  amount  of  processing 
and  storage,  but  does  not  necessarily  affect  the  degree  of  clutter 
shown  in  the  output  display.  This  offers  a significant  improve- 
ment over  some  conventional  approaches  which  integrate  ping-to-ping 
on  the  display  and  which  necessarily  operate  with  a clutter  rate 
sufficient  to  allow  small  echoes  to  paint  the  display  at  least  a 
small  amount  so  that  the  ping-to-ping  integration  process  can 
get  started. 
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4.  IMPLEMENTATION  OF  A SIMPLIFIED  PROBLEM 

4.1  PROBLEM  DESCRIPTION 

In  order  to  illustrate  the  effectiveness  of  this  tech- 
nique a simplified  problem  was  considered,  in  which  the  output 
data  were  taken  from  a single  sonar  beam  with  no  Doppler  informa- 
tion. 

With  this  simplification,  the  vectors  described  in  the 
previous  section  become  one -dimensional ; for  example,  the  position 
vector  represents  range  only.  The  estimated  position  in  the  next 
ping  cycle  is  determined  by  straight  line  extrapolation  of  the 
previous  peak  and  present  peak  positions.  The  variance  in  expected 
peak  position  is  assumed  to  take  on  two  fixed  values.  The  larger 
value  is  used  when  a track  is  initially  started  by  the  Secondary 
Data  Reduction  section  and  no  range  rate  information  is  available. 
The  small  variance  is  used  after  a linkage  has  occurred  and  range 
rate  is  known.  The  volume  of  suspicion  in  the  next  echo  cycle  is 
given  by  adding  and  subtracting  the  variance  from  the  predicted 
location.  The  output  statistics  of  the  linear  correlator  have  been 
analyzed  for  signal  plus  noise  and  for  noise  alone.  It  is  possible 
to  form  the  likelihood  ratio  of  a single  event  and,  by  a certain 
approximation,  to  reduce  the  log  likelihood  ratio  to  a linear 
equation  that  is  quite  accurate  for  the  region  of  interest  in 
these  calculations. 

4.2  OUTPUT  DISPLAY 

The  output  display  can  take  many  forms.  The  one  chosen 
for  this  example  is  convenient  to  produce  on  the  computer  printer. 
The  distance  across  the  computer  page  is  proportional  to  range, 
and  successive  ping  cycles  are  displayed  on  succeeding  lines  of 
the  page.  The  numbers  printed  correspond  to  the  amount  by  which 
the  log  likelihood  ratio  exceeds  the  display  threshold,  truncated 
to  an  integer.  This  value  is  not  directly  related  to  units  of 
standard  deviation  above  the  mean  or  any  other  commonly  used 
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measure  of  signal  strength;  however,  the  greater  the  value  of  the 
log  likelihood  value  of  a track,  the  more  certainty  that  it  is  a 
target  track.  Since  the  display  shews  the  amount  by  which  the 
threshold  is  exceeded,  an  increase  in  threshold  will  cause  the 
same  data  to  appear  to  decrease  in  value,  but  the  true  value  of 
the  log  likelihood  ratio  remains  the  same  and  is  given  by  thres- 
hold plus  the  displayed  number. 

4.3  EXAMPLES 

The  first  tracking  problem  was  generated  by  adding 
three  FM  slides  at  appropriate  times  to  simulate  targets  with 
range  rates  of  4 knots  closing,  0 knots,  and  5 knots  opening. 

The  output  signal- to-noise  ratios  are  13.7  dB,  9.5  dB,  and  10.9 
dB,  respectively.  The  tracks  are  designated  in  the  order  1,  2, 
and  3.  The  larger  fixed  variance  was  selected  to  accommodate 
targets  with  range  rates  of  ± 10  knots  and  the  smaller  variance 
to  accommodate  targets  with  a variation  of  ± 1 knot  in  the  estab- 
lished range  rate.  In  Fig.  3 the  display  threshold  on  the  log 
likelihood  ratio  is  2.94,  corresponding  to  an  approximate  proba- 
bility 0.05  for  accepting  a noise  track  as  a target.  In  Fig.  4 
this  threshold  is  9.15  and  the  corresponding  probability  is  0.01. 

In  each  case  the  assumed  output  signal-to-noise  ratio  was  13.7  dB. 
Track  1,  with  a matched  output  signal-to-noise  ratio,  was  tracked 
very  well.  Track  3,  with  a signal-to-noise  ratio  about  3 dB  lower, 
performed  reasonably  well.  It  took  considerably  more  ping  samples 
to  reach  a decision  on  track  2,  with  a signal-to-noise  ratio  of 
4 dB  less  than  the  assumed  value. 

In  the  next  example  actual  sea  data  were  processed.  The 
data  consist  of  the  output  of  a single  receiving  beam  of  an  AN/SQS-26 
sonar  system  for  92  ping  cycles.  The  target  was  closing,  and  had 
an  average  output  signal-to-noise  ratio  of  16  dB.  Two  displays  are 
presented;  both  have  a display  threshold  of  9.15  and  a larger 
variance  of  ± 10  knots.  The  first  display,  in  Fig.  5,  has  a 
smaller  variance  of  ± 2.5  knots.  The  second,  in  Fig.  6,  has  a 
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smaller  variance  of  ± 1 knots  and  a slightly  large 
signal-to-noise  ratio  of  17  dB  which  is  closer  to 
output  signal-to-noise  ratio  than  13.7  dB  used  in 
example . 


r assumed 
the  average 
the  preceding 
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FIG.  5 SEA  TEST  DATA.  ASSUMED  OUTPUT  S/N  = 13.7  dB 
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FIG.  6 SEA  TEST  DATA.  ASSUMED  OUTPUT  S/N  = 17  dB 


o 

«■>  O 

*0  m 
O'  O' 

— r*- 


■o  * 

£ o 
a.  a 


O a 

3 <\j  o o'  in 

» <M  »«.  O' 

in  eg 


o a 

o m 

»o  a in 

*■*  o —I 

O'  in 
O'  O'  o 

O'  O'  o o o 

O'  AC  vC  ^ 

O'  O'  eg 

o 


c o 

o o 

o o o r-  ^ 
o o o m 

O'  K> 


a o o 

o j p C’  rg  o 

o.nooo'-oo'O'O'  rgo  n (\j 

3 


5S3355$$3S8:S»3SS;&&5a3;233SS*S3SS;:£PS£|5fc|S£33i8 


FIG.  6 (Cont'd.) 
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APPENDIX  A 

SEQUENTIAL  TESTING  OF  HYPOTHESES 
A. 1 STRUCTURE  OF  SEQUENTIAL  TEST 

This  appendix  discusses  some  aspects  of  the  theory  of 
sequential  testing  of  hypotheses.  Suppose  it  is  desired  to  make 
a choice  between  two  hypotheses  Hq  and  H^.  Each  hypothesis  has 
an  associated  probability  density  function,  fQ(x)  and  f^(x).  To 
reach  the  decision,  a sequence  of  observations  x^,  X2 , x^,  . . ., 
are  taken,  the  subscripts  indicating  their  order,  and  two  positive 
thresholds  A > 1 and  B < 1 are  chosen.  The  likelihood  ratio  for 
m observations, 

m f L 

Lm  " M (x.)  * 
i=l  0 1 

will  be  used  in  the  sequential  test  in  the  following  manner. 

New  observations  are  taken,  and  the  ratios  L^,  L2 , L^,  . . . are 
calculated  as  long  as 


B < Lm  < A . (A- 1) 

If,  for  some  m,  Lm  is  less  than  or  equal  to  B the  test  stops  and 
the  hypothesis  Hq  is  accepted.  If  Lm  is  greater  than  or  equal  to 
A,  the  hypothesis  H^  is  accepted. 

A. 2 TERMINATION  OF  THE  TEST 

While  it  may  seem  that  the  test  could  go  on  forever, 
the  probability  that  it  will  end  is  1.  In  order  to  show  this, 
let 


f = logt  f 1 (x)  / f 2 00 1 . 
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now,  l will  have  some  probability  density  function,  gOO,  deter- 
mined by  the  density  of  x,  which  is  not  necessarily  fQ(x)  °r 
f^(x).  The  observations  x^,  X2 , x^,  . ..,  determine  a sequence 
*-l>  ^2’  ^3»  •••»  anc*  the  inequality  (A-l)  becomes 

m 

log  B < E t.  < log  A , (A-2) 

i-1  1 

where  log  B is  negative  and  log  A is  positive.  Let  C - log  A 
- log  B and  p be  the  area  under  g(-t)  between  -C  and  C.  If  any 
{ ^ is  outside  of  the  interval  -C  to  C,  one  of  the  inequalities 
in  (A-2)  will  be  violated  either  at  that  stage  or  at  a previous 
stage.  Assume  that  for  step  m - 1 

m-1 

Log  B < E l.  < log  A , (A- 3) 

i=l  1 

and  t > C * log  A - log  B.  Add  the  left  hand  inequality  of 
(A-3)  to  the  second  inequality 

m-1 

log  B + (log  A - log  B)  < E l . + l 

i-1  1 m 


log  A < E l.  . 
i-1  1 

The  inequality  (A-2)  is  violated  similarly  if  t < -C: 

m 

E I*  < log  B . 
i-1  1 

Hence,  a necessary  condition  for  (A-2)  to  hold  for  all  m is 
that  fall  between  -C  and  C.  It  should  be  noted  that  the 
inequalities  can  be  violated  even  with  this  condition.  The 
probability  of  a being  between  -C  and  C is  the  area  under 
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g(0  in  that  interval,  that  is,  p.  The  probability  that  the 
first  m observations  will  fall  in  that  interval  is  pm.  Since 
p is  less  than  1 this  probability  approaches  0 as  m increases, 
or  the  probability  of  termination  goes  to  1.  If  g({)  is  0 out- 
side -C  and  C,  a new  variable  X may  be  defined  by  letting  X^  be 
the  sum  of  the  first  r t's,  X2  the  sum  of  the  next  r I's,  and 
so  forth,  choosing  r large  enough  that  the  probability  of  a value 
of  X^  outside  of  -C  to  C is  not  zero. 

A. 3 THRESHOLDS 

Let  a be  the  desired  probability  that  the  hypothesis 

H will  be  rejected  when,  in  fact,  it  is  true.  Since  H will 
o o 

be  rejected  if  Lm  exceeds  A before  it  is  less  than  B,  A and  B 
must  be  chosen  so  that 

a = P(L^  i A)  + P (B  < LL  < A,  L2  » A) 

+ P(B  < Lx  < A,  B < L2  < A,  L3  * A)  + (A-4) 

Similarly,  if  6 is  the  desired  probability  that  Hq  will  be 
accepted  when  H^  is  true,  A and  B must  also  satisfy 

3 = P(LX  s B)  + P(B  < Lx  < A,  L2  s B) 

+ P(B  < Lt  < A,  B < L2  < A,  L3  i B)  + (A-5) 

Using  the  density  fQ(x)  in  (A-4)  the  probabilities  can  be  calcu- 
lated. Similarly  f^(x)  can  be  used  in  (A-5).  This  gives  a and 
3 as  functions  of  A and  B.  The  inverse  relation  could  be  solved 
for  A and  B in  terms  of  n and  8 . 

As  can  be  imagined,  this  could  be  a major  computational 
project.  Fortunately,  there  are  simple  and  accurate  approxima- 
tions available: 


A-3 


Let  A be  the  space  of  all  observational  sequences 


x^,  x3>  •••,and  be  the  subspace  of  sequences  that  result 

in  the  decision  Hq.  That  is,  for  any  sequence  in  Aq,  for  some 
m,  and  for  every  n < m. 


(A-8) 
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Similarly,  if  the  A^,  the  subspace  of  all  sequences  that  result 
in  the  decision  , is  considered, 

Aa  as  1 - 8.  (A-9) 

The  error  in  the  use  of  (A-6)  and  (A-7)  is  a result  of  using 
equalities  in  (A-8)  and  (A-9).  This  error  has  been  shown  to  be 
small  if  a and  8 are  less  than  1/2^. 

A. 4 RULES  FOR  SEQUENTIAL  TEST 

The  sequential  test  may  be  summarized  in  a few  simple 
rules.  If  it  is  desired  to  make  a decision  between  hypothesis 
Hq,  with  probability  density  function  fQ(x),  and  hypothesis  , 
with  probability  density  function  f^(x),  and  if  a is  the  error 
probability  of  choosing  when  HQ  is  true  and  8 is  the  error 
probability  of  choosing  Hq  when  is  true,  then  compute 


1.  A,  where  A =»  (1  - 8) /a, 

2.  B,  where  B - 8/(1  - a), 

3.  Take  an  observation  x^  and  calculate 

fl(xi) 

L1  . 

4.  If  L^  < B accept  Hq, 

5.  If  L^  * A accept  H^, 

6.  If  B < L^  < A,  take  another  observation  and  calculate 

fl(xi)f  (x2) 

L2 ' Ww  ’ 


1 

Wald,  A.,  Sequential  Analysis.  Wiley,  New  York  (1947). 
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APPENDIX  B 

DERIVATION  OF  A LOG  LIKELIHOOD  RATIO 

The  purpose  of  this  appendix  is  to  derive  a linear 
approximation  of  the  log  likelihood  ratio  for  the  processor 
used  in  the  examples  of  Section  4. 


After  the  correlation  process,  the  signal  peaks  are 
similar  to  a short  CW  pulse,  and  the  linear  rectifier  and  perfect 
averager  act  as  an  envelope  detector  for  this  pulse.  The  prob- 
ability density  function  of  the  envelope  of  a sine  wave  added 
to  Gaussian  noise  is  given  by  S.  0.  Rice^  as 


p(x,S)  = exp  (-  (x2+S2)  /2N2)  In((xS)/N2), 
N u 


where  x is  the  height  of  the  envelope, 

N is  the  standard  deviation  of  the  noise  before  envelope 
detection , 

S is  the  amplitude  of  the  sine  wave,  and 

Iq()  is  the  zero  order  modified  Bessel  function. 

The  likelihood  ratio  L(x)  is  given  by 

L(x>  = = I0(x  S/N2)  exp (-S2/2N2) . (B-l) 


A value  of  four  noise  standard  deviations  above  the 
noise  mean  will  be  chosen  as  an  average  peak  height.  Since  the 
envelope  will  be  subjected  to  thresholding  to  eliminate  small 
values  of  x and  the  assumed  value  for  S will  be  about  4*N,  the 
smallest  argument  to  be  expected  for  Iq  is  approximately  10. 


1 

Rice,  S.  0.,  "Mathematical  Analysis  of  Random  Noise."  Bell 
System  Technical  Journal,  Vol.  24,  1945,  p.  100. 
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This  large  value  allows  the  asymptotic  expansion  of  Iq  to  be 
used, 


IQ(x  S/NZ) 


exp  (x 


2ttx  S/N2 


Substituting  this  expression  in  Equation  (B-l)  and  taking  the 
natural  logarithm  yields 

l(x)  = log  L(x)  - x S/N2  - S2/2N2  - h log  (2nx  S/N2)  . (B-2) 

A plot  of  the  above  function  shows  an  almost  straight  line  in 
the  region  of  interest  greater  than  one  noise  standard  deviation 
above  the  noise  mean.  A linear  approximation  will  be  found  so  that 
its  slope  and  value  equals  that  of  Equation  (B-2)  at  the  average 
peak  height  of  four  standard  deviations  above  the  mean. 

As  given  by  Rice2  the  output  noise  mean  is\/ft  ^ and  the 
output  noise  standard  deviation  is  N\/2-^~  . If  r is  the  peak  height 
in  units  of  the  standard  deviation  about  the  noise  mean,  then 

x = tc^/2-7^  + \fyT  , 


x = (0.655  r + 1.254)N. 

Using  the  average  peak  height  of  four  standard  deviations, 
x = 3.87  N. 

The  slope  of  the  log  likelihood  ratio  is  given  by 


a = l ' (x)  = S/N' 


2 1 


and,  at  x = 3.87  N, 

2S.  0.  Rice,  op.cit.,  p.  100. 
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a - (S/N  - 1/6. 74)/N; 


also 


b - 1(3.87  N)  - a-3.87  N 

= 3.87  • S/N  - ^(S/N)2  - h log  (6.75n  S/N). 
Using  these  values,  Equation  (B-2)  can  be  approximated  with 

t(x)  ax  + b . 
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